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FOREWORD 



Schools, colleges; and departments of eduoation 
everywhere must cope with the^ problems of evaluating 
their programs, partioularly if they plan to seek or 
renew aQcreditation, Included in those evaluations must 
be the monumental task of finding out whether program 
graduates are performing effectively on the Job. 

While the literature in program evaluation implies 
that such a process is a systematic, incremental onej 
practice is very different* The current monograph grows 
out of several discussions related to the most recent 
phase of the University of Houston *s efforts to assess 
their teacher education program* The scope of the 
manuscript was broadened to consider the more general 
issue: my is it so (iifficult to obtain sellable, valid 
evaluation data on a teacher preparation program? 

After several letters and phone conversations, the 
authors agreed to chronicle their efforts to evaluate 
the University of Houston's 10-year-old competency-based 
teacher education program and to track the progress of 
its graduates. The final publication describes the 
authors' plan of action and the problems they faced in 
trying to set up a workable program and make revisions 
to its operations on the . basis of .often imprecise 
evaluation data. The purpose of this publication is to 
increase the awareness of teacher educators in other 
institutions so that they might possibly avoid many of 
the problems that plagued the Houston team. 

We gratefully acknowledge the professional 
contributions^ of the Houston team—Drs. B, Dell Felder, 
Loye Y. Hollis, and W* Robert Houston--all of whom are 
on the faculty of the College of Education at the 
University of Houston, We would also like to thank our 
content reviewers, whose conunents were invaluable in 
ImprGving the manuscript. 

Readers are invited and encouraged to comment on 
this monograph and to submit related documents to the 



Ciearinghouse for possible inclusiori in the ERIC system* 
For informations write or call the Senior Information 
Analyst^ ERIC Ciearinghouse on Teacher Education, Suite 
610/ Washington, DC 20036, or (202) 293-2450. 

ERIC, also known as the Educational Resources 
Information Center, is a nationwide information storage 
and dissemination system of the National Institute of 
Education* Through its network of 16 specialised 
clear inghousrs y ERIC collects, evaluates, abstracts j and 
indexes educational literature, much of which is 
unavailable from other sources. Document literature 
includes project descriptions, curriculum, guides, 
instructional materials^ conference speeches, and many 
other kinds of non journal articles and papers. The 
preliminary pages in any issue of ResQurces in 
Education » the ERIC monthly document abstract 
periodical, explain how to retrieve material fi'^om ERIC. 



SHARON G, BOARDMAN 
Editor, ERIC Clearinghouse 
on Teacher Eduoation 
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-EVALUATION: . THE HOUSTON EXPERIENCE 



Almost a decade ago when the design for CBTE was still 
on the drawing board, the College of Education of the 
University of Houston began its competency-based teacher 
education program. Although there was hops that a 
ooopetency-based approach would offer improveaents over 
conventional methods for preparing teachers, no one Imew 
much about how to develop, operate, or evaluate such a 
program. Problems still exist and some issues have yet 
to be resolved, but Houston's undergraduate CBTE program 
is established and operating. 

Efforts to evaluate this CBTE program have proven 
both difficult and costly, and many lessons have been 
learned along the way. The need for systeaatle 
evaluation of teacher education efforts is widely 
acknowledged, although research has shown that few 
institutions have succeeded in evaluating their teacher 
preparation programs or conducting follow-up studies of 
their graduates. During the spring of 1978, the 
University of Texas Research and Development Center and 
the National Institute of Education attempted to report 
what vras known and understood about designing and 
conducting teacher education program evaluation and 
toilow-up studies. They contacted teacher educators 
nationwide to identify institutions engaged in this 
effort. Much to their disappointment, they "were unable 
to unearth a large number of Institutions where there 
has been a serious commitment to conducting these 
studies" (Hord and Hall 1978). Those institutions that 
have been engaged in such program evaluations have 
approached the task quite differently (Hord and Hall 
1978- Cooper et al. 1980), thus making it difficult to 
relate their efforts In meaningful ways and Itarn from 
each other. 



in this monograph, the experience of the University 
of Houston to evalaate its teacher education program and 
to eonduct follow-up stCidles of its graduates will be 
shared. The account Includes a short discussion of the 
findings from the last two follow-up studies , and the 
authors' reflections on evaluations and follow-up 
studies. This brief account is Intended to shed some 
light on a complex subjectj insight that might prove 
helpful to others contemplating or conducting teacher 
evaluation studies* The paper is not intended as an 
evaluation report of Houston's CBTE program* 



Working Up To Evaluation 

Improvement of teacher preparation was the impetus 
for developing CBTE at the University of Houston* While 
the crucial role of evaluation was recognized from the 
outset, it yms several years before the program was 
sufficiently developed to permit substantive evaluation* 

The first experimental CBTE program was launched in 
1971 and involved 64 students* The following yearj a 
second pilot program involved 121 students. With 
encouraging results p the faculty voted in spring 1973 to 
use a competency-based approach in all undergraduate 
programs of the College of Education* During tlie 
1973-*74 school yeari all entering undergraduates 
participated in the new CBTE program. 

During that first yearj several problems arose, the 
resolutions of which required most of the next year and 
resulted in major modifications to the program*a design, 
this caused a two-year delay in development of a 
comprehensive plan for program evaluation. 

The students in the pilot program had volunteered 
tfo pat"11tipate and expected a nontraditional program. 
When the program vas expanded to include every student, 
many of the new participants encountered difficulties 
with the^ leas traditional modes of Instruction, They 
would often take the. course of least resistance or 
complain beemuse Instruotors were not olear 'about 
expectations. 

Four instructional teams, taeh consisting of four 
professors and a counselor, were created to coordinate 



the program. Each team was assigned to work with a 
group of students who, with their professors, were to 
remain together Cor the duration of the two-year 
preparation program. 

Although the program remained within the 
state-approved^ teacher certification course structure, 
it \m3 designe'd to be an individualized, highly personal 
experience for students < Arrangements were made with 
the University of Texas Research and Developraent Center 
to use the instruments and processes pioneered by 
Frances Fuller (1969) to identify the concerns of 
prpservice teachers. Group process sessions and 
individual testing and counseling provided students with 
Continuous feedback about themselves and their 
performance in the program. Students were given options 
on how they would achieve their objectives and were 
expected to negotiate the specifics of their program 
with professors. 

Among the faculty, a philosophical difference of 
opinion arose regarding who decides the competencies 
required for entry into the profession. Some faculty 
believed that students should discover for themselves 
the specific objectl/es for competencies associated with 
effective teaching. Intensive group and individual 
counseling and close association with a practicing 
teacher in the field were scheduled to assist students 
to do this. Other faculty thought that the competencies 
required for certification should be decided by the 
faculty and that certain instructional objectives should 
be conmion for all students while others could be 
negotiated. Although this faculty ^group supported the 
idea of alternative learning activities, they believed 
program objectives should be Glearly specified and made 
public In advance of instruction* 

As structured j the program required a great deal of 
faculty time. Establishing objeGtives with individual 
students I designing instructional activities, evaluating 
performance, arranging for field-based experiences, and 
meeting with team members were time consuming. Some 
faculty questioned whether teaching in the program would 
permit them to survive In a "publish or perish" academic 
world. Also, although conmitted ' to the innovation, many 
faculty members did not have the experience or insight 



of those who had developed the original program design, 
and sometimes they would adjust their courses in ways 
that were at varla'nce with the intent of the CBTS 
program model* - 

The program had a strong field-based Gomponent 
whsre another problem emerged In the pilot programs, 
each student visited at least three teachers during the 
first semester. and selected one to serve as a 
cooperating teacher for the two-year period. Student 
teaching raa to be done with this teacher* The problem 
was that more than 500 undergraduate students entered 
the program each semester in 1973-74. As each of these 
students visited three teachers in the schools 
selected one to serve as a mentor , many of the nearly 
3iOOO classroom teachers in Houston began to complain 
that they were being evaluated by undergraduate 
students- This became an unresolvable problem. The 
choice was to modify the program or lose the cooperation 
of the public schools. The decision was made to assign 
students to cooperating teachers ^ thus eliminating 
student selection. 

These problems made it apparent that the 
experimental program was not a reasible design for 
collegewide implementation. As a result, the College 
Undergraduate Studies Comittee formed a CBTE Task Force 
in spring 1974 to revise the program design and 
recommend a mangaement system for its operation. 

Until this time, responsibility for managing the 
program had been shared among department chairs, 
associate deans, and key faculty who held leadership 
positions in the experimental projects* Because roles 
were not always clear, some problems^ tended to get too 
much attention from too many people while other problems 
seemed to be overlooked or ignored because everyone 
assumed that "somebody else vras taking care of it." The 
CBTE Task Force reconmended creating an administrative 
unit called the FrofesslQnal Teacher Preparation Program 
(PTPP) to operate outside the departmental 
organiMtional structure. This new administrative unit 
reflected the view that the program shdald be an 
Instructional system—an integrated whole--and as such 
was the responsibility of the College of Education, and 
not of individuals. A PTPP director, working: with a 



management team called the Program Development and 
Implementatien Cqunedl (PDIC), was assigned 
responsibility for administering the program. The PDIC 
subsequently played a major role in coordinating program 
development and evaluatiQn, 

In revising the design for the program, the CBTE 
Task Force' assumed that the most important and valid 
competencies of teachers could be speeifitd and 
assessed, and that these competencies could be learned 
and demonstrated through properly designed instructional 
systems. As a first step, the task force derived the 
characteristics of the desired teacher preparation . 
program, subsequently approved by the College faculty to 
give direction for program development and serve as 
indices' for implementation. The 12 characteristics are 
listed in Appendix A. 

Throughout 1974-75, an extensive effort involving 
many faculty was underway to identify and approve 
generic teaching competencies that all students would be 
required to demonstrate for certification as teachers- 
Once approved by the faculty, these oompetency 
stateraants were used to identify instructional 
objectives, dpsign Instructional materials, and evaluate 
performance. They were also used in program 
effectiveness studies and they provided a basis for work 
toward a valid, reliable instrument to measure 
competency demonstration. The 16 compatencies are 
listed in Appendix B* 

The revised CBTE program at Houston ras put into 
use during the 1975^76 school year. The first students 
to complete this program were graduated in the spring of 
1977,^which v^s the target for initiating a systematic 
evaluation of the-, program. 



Evaluation 

Recognizing that systematic revision is necessary 
to refine components and respond to changing needs, the 
PDIC agreed from the outset that program decisions 
should be made on the basis of systematically collected 
and ^alyzed information. This conmitmentj as well as 
the desires to validate teaching competencies and assess 



the q^uality of program graduates, resulted in. the 
oreation of a Researoh Task Force, Appointed by the 
- PpIC in 1975, it was charged with developing and 
^implementing ^evaluatLon and follow-up studies of the 
program md Its graduates • 

Aid ^ members of ^.,the Researeh^ Task Foree had been 
ihvoivtd with program development, but none was an 
expert In program evaluation. ^Similar work at the 
Oregon College of Eduoation In Monmouth, Ore,, attraoted 
^ the groups s attention and arrangements were made for 
them to visit and review evaluation efforts at that, 
institution^ During the vi^it, the first hint of 
problems to come beoame apparent* H. Del Shaloek and 
his associates described the difficulties they 
— encountered at Oregon — ficulty apprehensions regarding 

the evaluation process, their indifference to evaluation 
^^data, problems of locating and following graduates 
V^uring their first years of teaehing, and the costs of 
conducting studies* Despite these discouraging notes, 
the" Houston team was Impressed and returned to set about 
the task of designing evaluation studies for their 
"program. Four kinds of studies were envisioned: 

r. Program evaluation studies to determine th% 
. extent to which conceptualized elements or . 
characteristics of 'the program were operational 
in the training sysEem, and the utility and 
suf fioiency of these program components a^ 
perceived by preservice teachers, program . 
> - -^graduates and others. 

2. ^Program efftctiveness Studies to determine the 
extent to which graduates icqOlred the 
competencies. - v- ^' 

^ - J'Pfpgrairvalidation stUdl-es to establlBh that 

- ^prpgram-^compit^^^-wfre "pq^ to 

^.^^-^ pupil achievement. ' r ' _ 

> U;.^ User = satisfaction. Btiidla^ to assess the 
- ^ ' attitudes 'of .graduate© and their employing 
institutions toward the program's outcomes. 



The task fome agreed that the s^aluation proGess 

Provide information whioh would be used to 
support the instruotional syatem's efforts 
to faeilitate student eompetency 
attainment* 

Provide information coneernng student 
progress, student aehievemtnti and program 
effectiveness* 

Provide information which would be useful"^ 
in promoting closer and more productive 
co^unioatlon with students. 

Provide information which would be 
i*#sponslve. to the expressed da'ta needs of 
faculty vriao^ were implementing the program. 

Provldt data which ¥^rc, timely ^ easily 
obtained, and credible*. 

6. Provide an information base for ^ 
dtcislon*making relartb^to program 
revision. (Coopered Weber 197?) 

Because air of the events connected with the 
University of Houston »s efforts to evaluate its teacher 
preparation program ^e^not described In detail herCi an 
overview of these activities is presented in table ^. 

When the first graduaites of the revised program 
vrere In their last semester, it seemed especially 
important to determine the extent to which the program 
was, or jmm becoming, what it Intended to be. The 
program was evaluated in spring 1 977 to see if it had 
the characteristics appnoved by the faculty,- that is, to 
what extent was^ the program competency-based? James 
M. Cooper ^d Wll ford A, Weber, who designed and 
conduoted^.the study, described its salient features i 

First, pfogram designers had spent 
considerable effort to conceptualize and 
^specljQf^he instructional systetp 



should I 
1. 

3. 

5. 



TABLE 1 
CALENDAR OF EVENTS 



1973-7^: CBTE adopted odllegewide at undergraduate 
level. 

197^*75 1 CBTE program extensively revised | new 

organisational structure oreated* 
SPRING 1975: Researoh Task Force appointed* 
SPRING 1977i First students to complete revised two 

year^program are graduated* 
SPRING 1977i First program evaluation study eonducted, ^ 
SPRING 1977* Student teacher success and competency 

validation study oonduoted* 
SPRING 1977: Study of the affective characteriatics of 

undergraduate students conducted. 
SPRING 1977i First, follow-up study of program graduates 

conducted. ' 
FALL 1977: Performang^ Evaluation Instrument Committee 

established. 

SPRING 1978: Telephone contact with griduates to devise 

more effective follow-up methodology. 
SPRING 1978: Second program evaluation study data 

collected. ^ 
SPRING 1979:, Second follow-up study conducted (Spring 

1978 graduates)* 
SPRING^FALL 1979: ' ^ird follow-up study conducted 

(Spring 1979i graduates). 
SPRING 1979 1 Comparison of Performance Evaluation 

Instrument and National Teacher Bxaminatldn for 

evaluation of student teaching perfbrfflance* 
SUMffiR 1979: Change in College admlnlstratipn. 
SUJmER*FAtL 1980^: Fourth follow-up study conducted 

(Spring 1980 graduates). ^ 

-r- - - — ^ r--- - ^ r - - — • ' - 

■ ^ _ ■ ■ r 

' characteristics they believe were esseptial to 
program effectiveness j and It appeared to be 
of benefit to determine t4ie extent to which 
they were successful in operatlonalizing their 



Qondeptualliatlan. Saoond, while much had 
been vritten aid said about coopetenay-baeed 
teacher education, It appeared that few 
competency-based teacher aduoation programs 
existed. Indeed, there were ^uca tors who 
seemed to express ^doubts concerning the 
viability of creating such programs* It ras 
assumed . that there was benefit to be gained by 
testing .that assumption. Third, if anything 
was to be said about the program's 
effectiveness with regard, to Its ability to 
facilitate student competence, it seemed quite 
essejitial that the riature of that program's 
Instructional system be thoroughly described 
and understood. Fourth, if the program ras to 
be improved I there raa a crucial need for ^ 
Information about the nature of Its 
Instruotional system*^ (Cooper and Weber 1* 



IndlQators were generated and approved f^r eaeh of 
the 12 program, Gharaoterlst lea. Questionnaires using a 
nine-point Likert rating soale were designed to collect 
perceptual data from atudents, faculty, and school-based 
teacher eduoators. Program dooumenta and policy 
statements mrm identified and qoUeoted along with 
copies of all instructional raodulea and materlala. A 
ehecklist was developed to analyze theae documeh'ta and 
instructional materiais to determine whether they were 
indicatora-of approved program chftraeterlatles. 

Compileted questionnaires were received from 309 
atadents in the pre-studant-teachlng phase of the 
programrigi student teachers | 22 university supervisors 
of student. tpaohers I and 223 sohool-based teacher 
educatora, who irorkbd with atudenta in the 'field ' • 
component. The aimmary data Indicated "that"; all foFjr 
groups generally agreed that all 12 program 
..eharacteristics were present" (Cooper and Weber 1977) . 

The document analysis findings auggested that 
certain program characteristics had not been barf led out 
to the extent the qMestlOTnalre data indicated. It '^s 
decldetf that program, assumptions needed to be examined 
for the purpoae of reaffirming, modifying', or'deliting 
them. Also; efforta were Intensified to .oake sure that 



all faeulty members understood how the Instructional : 
system charadteristias^they had adopted should be 
refleetad ^In every aspect of the CBTE prograffl^s . 
operation. Specific problems in program operation were 
singled out for correotion* For example j an 
inconsistency In format for training m^ules ma 
creating confusion among students j a task force was 
appointed to study the problem,' and its recoimendation 
of one format was adopted* 

Three other studies were conducted during 
spring semester, all important early steps toward 
judging and validating program effectiveness* One 
, study, by Howard L, Jones and Robert S* Randall, asked 
students how successful Uaey thought they had been in 
using the program*s generic teaching competencies md 
how important these skills are to effective teaching. 
Indicators to assess perceptions were developed for each 
generio competency and a five^point Likert rating scale 
was designed to gather data. Using the same 
questionnaire, university supervisors and school*based 
teacher educators rated the Importance of the competency 
indicators to effective teaching, and Judged the 
performance success of student teachers they had 
supervised during the semester. Responses were obtained 
from 191 student teachers, 22 university supervisors, 
and 223 school-based teacher educators. 

Respondents generally agreed on the .importance of 
the competency indicators to effective teaching, and 
student teac^iers were judged-to be pei^forming those 
competencies suceess fully in the classroom. The student 
teachers rated themselves higher on performance than did 
their university or sohool*based supervisors (Jones and , 
Randall 1977). 

The results of this study were important in 
confirming the slgnifiaanoe of the 1 6 generic teaching 
competencies in the revised program design* Data 
supported the decision to continue using these 
oompetencies in program development and operation. 

A second study collected an array of demographic 
variables from 500 students trolled in the. program* ^ 
The Research Task Force envisioned using^theae data in 
future research on isolating particular characteristics 
of effeetlve teaehlng. It ma decided also -to aupporj a 



study to eojlect affedtive data from these students, who 
were enrolled In one of three certifloation 
prograros^ — elementary, seoondary, or all-level (music, 
art, health, and phyaieal education). The affective 
study would determine if any of these program groups - 
showed a mlque profile of stmilar affective 
Gharaoterls^ties, as indicated by data from the Minnesota 
Teacher Attitude Inventory, the Adjective 
Self -Description, the Work Motivation Inventory, and 
Cognitive, Style Mapping. .No unique profiles were found 
for any of the three groups (Jones and Randall 1977)* 

The third study that spring ras the first of four 
follow-up studies of Houston's CBTE program graduates. 
This study and a fourth study-^ that mu not part of the 
original plan are described later. . 

Program effectiveness and program validation 
studies require a ralld, reliable Instrument to measure 
teaohing ^competence. Although standard criteria for 
evaluating student teachers vms used throughout the 
program, the Instriaaent itself had not been validated or 
tested for reliability. This job ras glyen to a 
Performance Evaluation Conmittee, created not only to 
validate ^d establish the reliability of an instrument 
to measure teaching performaneep but also to study the 
feasibility of its use at various student progress 
checkpoints during the pt^ogram. The oommittee^s efforts 
took the better part of ^two years, as^ the instrument was 
revised several times, on the basjts of eictensive feedback: 
^from publlo school teachers, students, and student 
.teaDhlng supervisors* Tti§ final instrument, the Student^ 
teacher Sumaative Performance Evaluation Instrument 
(PEl) , ,oontained six categories i ^ ^ 

.1. Planning and Preparing for Inatruction 

2. Performing Tnatractlonal Fuhdtldns 

3* Using Student Data 



Rel,ating Interperfionally 



5* Professionallam 
6* Related Experienae 



The next step was to devls© a feasible prbeedure 
for. assessing teaohlng perforianoe at interim and exit 
oheokpoints in the program. It w^b deoided that a 
progress oheok would be most useful Just prior to 
student teaching* A formal evaluation, of teaohing 
Gompttence at this time eould be used' to diagnose 
potential teaching problfma and would provide 
Information useful to student teaching supervisors* A 
group of professors wer^ asked to pilot test the PEI, 
Results from data on the time required for the 
evaluation^ the level^of confidenae instructors had , in 
.their mtings, and t^e format of the Instrument were not 
ancouraging* The Instrument was difficult to use and 
took too much time to complete* 

The format of the Instrument was revised and a 
second pilot test ^Initiated ^rly in the spring semester 
of 1979* This time, data about the evaluation 
instrument and procedures were enoouraglngi and 
instructors' rapprted high confidence In their ratings. 
Concurrent studies of the PEI were made to find if 
the scores obtained could validly and reliably tell high 
/ from low con^etent student teachers. and to Investigate 
raliability r^orig the raters. According to Piper and 
0»^llivan /( 1981), "It ras aoncluded from the results 
that the PEI can reliably Md validly be used to 
identify fiigh and low eompeterit students." 

^Me^4lhl^e| durinig the siamaer of 1979, the College 
of Education .changed administrations and subsequently 
was reoif'ganized. The new administration was not as 
oonsnitted the CBTE program as outgoing Dean Robert 
B. Howsam tad been* In the reorganisation , the 
leadersiiip of the undergraduate program ims shifted , the 
Program Development^ and inplementation Council was 
abolished, and the committees ^d task forces that ..had 
been functipning to djivelop ^d evaluate the program, : 
were, not reaotlvated*" w these changes, the ' 
long*-ran^e researQb-=-plans and continued development of 
the PEI were discontinued* v 
; Original pland oalled for all methods course 



Instruotors to use the PEI to evaluate their students In 
late spring 1979, and that these ratings would be ■ 
oompared with ratings of these same students' 
performances during the fall semester that year. Plans 
for the fall study were never executed. 

During that spring, however, a study that estimated 
the concurrent validity of the PEI was conducted. The 
scores Of 32 eleiflentary education student teachers on 
the PEI were correlated with their scores on the 
National Teacher Examination CNTE). The results 
suggested that those students who tended to do well on 
the NTS, a measure of teaching knowledge, also tended to 

fP^nSi^ °H nil fff* ^ ^3urm of teaching performance 
(Piper and 0' Sullivan 1981). 

,^^^.JMi$.^orta to develop 6he PEI were underway, 
four follow-up studies of program graduatea were " ~ 

conducted. Attempts .^wene^mad& In the^^spclng semesters 
of 1977, 1978, 1979, and I98O to collect data from 
graduates. During the last two years, after 



reorganization of the teacher preparation program, 
individual faculty members continued the research. 

The most serious problems in the teacher education 
evaluation efforts occurred with these four studies, 
which were Intended to gather perceptual data from 
graduates to, use with the PEi for program effectiveness 
and validation studies. The follow-up evaluation effort 
quickly became a search for workable methodoloffif 
because major difficulties arose with efforts to. collect 
data from graduates trtio were no longer bn, campus. As ■ 
long as :^<'espondents were mrolled ' in the program, 
gathering informatipn was relatively simple because of 
easy , access, to them and because most students agreed to ' 
ecoperate m the voluntary evaluation program. After 
graduation, however, finding these participants and 
obtaining their cooperation "prov.ed difficult. * , 

The first of the four foUqw-up studies ras ^ 
launehed in spring 1977. Students who were, graduated 
from the College of Education In .fair 1975 ithrough 
spring 1976' were iMiled questionnaires asking their 
perceptions of the Importance of the program 'sM 6 ' 
generic teaching competencies and their assessment of ■ 
their performance of these teachings-behaviors. % ' 
Addresses were obtained" fronj College fUlea and from the 



is......'':" ■ 13 p.,v' " ' ■ ''■ 



ERIC 



University Alumni Offioe. More than 500 questionnaires 
were mailed , but within two weeks, the U.S* Postal 
Service had returned 267 with notices of Inoorrect 
address. Only 17 responses were reoeived^and no useful 
data were obtained ^ thus precipitating a search for more 
effeetlve procedures* 

In the second study, all upooming graduates were 
telephoned in the spring of 1978 and asked if they would 
participate In a follow*up study at the end of their 

-C4#s t— yaa g ^^-tearch 1 Etfl^ — ^oat=agraad=^d^.promi3ed to 
advise the evaluators of any change of address. In 
spring 1978, a sample of 60 of the gnaduates were mailed 
a questionnaire and also asked if they would agree to 
telephone interviews * Thirteen questionnaires were 
returned. These graduates were interviewed and invited 
to attend a group meeting on campus* Seven persons 

^pirtl^lpated^ Again, numbers wera too small to yield 
useful data* '^^'"^ -=^- 

- .. In spring 1979 f yet another strategy was tried. 
Investigators met with all student teachers to explain 
the folloW'^up study and seek volunteers. Thirty 
students agreed to participate In the study that was 
proposed to Identify problems faced by graduates during 
their first year of teaching, to determine the ways they 
coped with these problems, and . to evaluate their 

.teaching performahce in the next several years. Data 
were collected during four dinner meetings at the end of 
student teaching (May 1), at the end of orientation 
workshops conducted by employing school districts 
(August 23), and at the ends of participants' third ^„ 
(September 13) arid ninth (November 15) weeks as 
classroom teachers* ^ During these meetings, part^icipants 
completed §n open-ended questionnaire and the Teacher 
Concerns Questionnaire ^ . and in gro^p sessions -^they ^ 
descirlbed their concerns, problems, and methods for 
coping. These disQUsslpns were audiotappd for later 
analysis/ In addition, participants audiotaped their-^ 
own perceptions at ..the ends of the first Md sixth weeks^ 
with students and^nfelled these to investigators. Plans 
called for observation ind on-fSite intervrews with these 
graduates and their professional colleagues and students 
during spring 198O and in subsequent years, but these 
prooadures were abandoned because of, the College 



reorganization. 

Results from the four data aollectiona indioated 
that these beginning teachers enoountered a series of 
une^peoted problems, some of which had not been 
Gonsidered by the designers oftheir teaoher preparatiqn 
program (Felder et aL* I98O). These findings oaused our 
faoulty members to undertake another follow-up study to 
clarify the problems encounterad by new teachers and to 
suggest ways to redesign teacher preparation programs 
and my s to ease the entry of beginners into the 
profession. 

To obtain a study group, the faculty conducted a. 
workshop for beginning teaohers during the summer of 
igflO, Administrators in Houston school districts were 
asked to publicize the workshop and 22 new teachers, 
graduates of 13 different Institutions, attended. All 
agreed to cooperate In the proposed study to. identify 
±Jia^jiroMams- they__gncaunlgred^r Ing their Initial year 
in the profession* . ~ — — 

Data were- coileoted on a delphl-based rating system^ 
and clarified in a series of three-hour sharing 
sessions.- In describing the study, Houston and Felder 
reported: 

One of the problems of pre--specifled rating 
scales is the lack of 'consumer orientation. 
Problems aynd eoncerns stated on the ^ Inst riaient 
may or may not be the real ones for a 
particular popuiation* To treat this 
weakness, we asked all beglnhing teachers to 
identify on 3" sc 5" cards their concerns and 
problems. These were sorted out and 
synthMlzed into 54 questions which represent^ 
> the combined thinking of the group.. In a 
second step, teachers responded on a 
seven-point scale to eachvOf the 5^ questions. 
This procedure permlttad items to be specific 
and precise with respect to' the particular 
group while permitting malysis of the depth ' 
^^f concern for each item by each participant, 
(in press) 



Insights From Two SuCGeasful Follow-^up Studlea 

. Although the follow-up studies were plagued by 
methodologidal dlfflQUlties that limited the usefulness 
of their data, they nevertheless provided some 
^ interesting insights into the world of the beginning 
teaoher* Before the beginning of sGhool, the new 
fceaohers were Qoncerned primarily about the expectations 
of their principals and fellow t^aohers, about 
disolplining students, and about planning and preparing 
for instruction I 

A certain detachment pervaded their ooneerns 
and their perceptions of themselves in school. 
Their converations reflected a third person 
perspective^ Their problems were 
hypothetical; their work orientation less 
systefflatic or focused than when tackling other 
more familiar problems* 

Despite their concerns ^ these beginners 
___^;elieved in themselves, were buoyed by the 

posif ivY^f eHdbaok--the^^^ ^en of f ered 

their first job, and looked, forward to IJorking'^^™ — 
with children and youth* They thought they .. 
knew irfiat teaching ms all about • Thi^ir 
attitudes could be characterised as euphoric. 
(Houston and Felder in press) 

The realities they encountered as beginning 
teaohers were unexpected and often deyastating. The 
novices' initial orientations to their new sohoQls 
tended to be a series of meetings and a blaze of 
Instructions , with little time .left for setting /up 
clilirooms'isr^^epaf^lfi^^ students. 
During the first weeks of school, the riqurrecf^^^— — 
administrative paperwork overwhelmed many of them, and 
by the third vreek, their priorities had shifted tojlme 
management ^d dealing with fatigue. Many expressed a^ 
sense of being out ^of control, of just makiTig it from^ 
one . day to the next . ^ ^ .-^ . . ^ 

By the end of the ninth week, the level of ^ 
Importance these beginning teachers placed on wery 
concern they had Identified had been reduced more than 



one point on a seven-point scale. Concerns that 
rematnad high eenterad on issues related to student 
achievement, elassroom management, dealing with parents 
and time management. The level of stress had tased for 
most and some reported that they felt in control and 
enjoyed teaching. Howtver, a few voiced serious 
thoughts about leaving teaohlng at the end of the 
semester or the school year. 

How did t^se beginning teachers cope with their 
problems? Most of them expeo ted to cope by being ' 
prepared for class, talking with their principal or 
other teaohers, and searching for new ideas. The rays 
they actually eoped during the Initial days of school 
were less systemfttla. They searched for anyone who 
would listen to their concerns and frustrations and 
appeared to long for a "sounding board." Kiey quickly 
realized that the principal and other teachers were 
often too busy with their own tasks to help much, and 
they experienced feelings of isolation and helplessness. 
They worked long hours just to keep up, and reported 
thay w^e spending more and more time in their rooms 
after school doing paperwork and planning^ 

Our experience In these studies of beginning 
teaohers, alt-hough limited in many ways, causes us to 



1. Obtaining and ^ retaining subjects for follow-up ^^--^^ 
studies was much more difficult than any of ua had 
expected I None of the fouf different strategies we 
tried proved to be Effective, we suggest that 
others planning follow-up studies need to^ give Mple 
consideratibn to possible prpbleras of they may 
experience unexpected costs, delays, and 
disappointments, 

2, Regardless of the institution from which they 
graduated, the beginning teachers we studied were 



-Bot^pr^ared^ for somfe of the tasks being performed 
by exparlenced teaDhersT^^hQ have developed routine 
ways of handling many tasks, 'When the behaviors of 
effective teachers are analysed and used as a basis 
f OP identifying competencies to be developed in 
teacher preparation programs, it is apparently easy, 
to overlook the need to brain explicitly for some 



ponSer serermi^pointsj. 





subtla, but important, routines. 

Beginning teaohers were txpeQted to perform with the * 
same degree of expertisa as teaohers with years of 
experience. Beginners were provided with little to \ 
east or assist their entry T^nto the world of work. 
School orientation sessions were a combination' of 
welcomes and information dissemination, neither of 
which contributed tp helping the beginning teacher 
get ready for that first day with students. There 
often ymm no one assigned to provide professional 
help to these begimers, who learned how to survive 
^ through trial and error as trouble spots emerged. 
We believe that such an experience must strongly 
influence a teacher »s future attitudes and 
performance, and we wonder if it is possible that 
teaoher burnout I tejacher dropout , and teacher 
indifference may begin during this time. 



Refleatlons and Suggestions 



# Our work has aontinued for more than; a deoade and 
we realize as we reflect on our experience that our 
viewpoint may bf biased. Yet, we believe the fQllQWing 
eight pareeptions are important enough to share. 




As a profession, teaching. must dlscQVer and 
. transmit those bahavior s that are positively related to 
desired learner outoomes. Teaching must provide a ^ , 
servioe that society aoknowledges' as worthy^:- of support. 
That means the individuals who perform^ this service must 
^'o^Teorlcompetently enough to warrant public trust fiid 
conf idenSr^^a^ tetphing can Mke a difference, If ^ ^ 
those who prepare'^^eaohers aocept the premise that 
teachers can and should positively influence - pupil 
achievement, then it becomes the job of teacher 
edyoation %q Identify those eompetencles that 
^haractwlze "effective teaching" and asslst^ prospective 
teachers and :inservice ^eaehers^ trf acquire them, 

' The most ef fective an^ affioleht programs for ^ 
preparing teachers are designed as regenerative 
instructic^ al systems i the sucoessful operation of such 
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. systems requlrt .that deQlsions must be data baaed . When 
oorapebahoiea associated with effective teaching are 
known or can be eonfidantly assumed ^ teacher education 
' programs can be designed and delivered as integrated j 
unified s self -renewing instructional systems that are 
explicitly purposive. Such programs^ tend to be output 
referenced and data dependent andj because of their 
connectedness and regenerative qualities,' 'can be 
explioted to achieve their purposes more effectively arid 
efficiently. However / developing an instructional 
system reguires the collaboration and cooperation of 
many diverse faculty members, often from several s 
different departments, these faculty, generally trained 
in specialized fields such as educational psychology, 
math education, and health or physical education, often 
must learn how to think like "teacMer educators," that 
;is, to refocua^their attention from their narrower 
specialisations to a larger, more holistic concepjiion of 
the teacher preparation program. Without this gestait, 
program components designed by individual faoulty^lll 
be disconnected and will not .^form an integrated ^wMle. 
Change in any part of the system will affect other, 4 
parts f hence, decisibns to alter the program must be 
made, collectively by th§ faculty hather* than 
individually. It is critical to the success' of the 
program that such decisions be made on the basis of the 
best possible information to assure that the wisest 
coursr of action is pursuisd. Insofar as possible', such 
data should be obtained through program evaluatidn * 
efforts and teacher effectiveness research, as both have 
a » contribution to make to the business of program 
design, development, and dperation../ ' 

• .% ■ . / . ■ ■ - ' . 

ft clearer distinction needs to be made between 
research and program evaluation, and the value^ for each 
for contributing to the .professional knowledge base Tn 
teaching should be acknowledjged . Program evaruation and 
research are often confuse. Teacher education lias a 
two- fold function, to discover and to transmit fffective 
teachihg behaviors. ^ It might be stated sifflplistically 
that thFQUgh research we discover what those behaviors 
are and through program evaluation we develop hunches 
about what they might be and ^ learn how to. effectively^ 



train for them. In researGhj one has the luxury of not 
baving ^o raake a decision* It can always be argued that 
data are insufficiently validrand reliable to permit 
useful conclusions. In program evaluation, the 
operation of^ an ongoing program demand^ that decisions 
be made. Program decistons will not wait for "perfect" 

-data; they must ^be made regardless of the quality of the 
a^vallable data- The question in prograto evaluation , 
therefore,' isT-^I^ILt are . the best data one can get at a 
pricp one can affor4?""The ^suiting "muihiness" of data 
30 often criticised by 'those who oo^fyse .tfie, purposes of 
progi am evaluation and research should not obscure, thji 
very necessary and useful professional /oontrlbutlon that 
results from evaluation studies. It is only thro^h 

^ mora open investigation that we can Improve our ability 
to train teachegs and( can generate hypotheses tl^at more 
rigorous research metftods might, test. 

Faculty who have been Involved in the design., ' 
development # and operation of innovative programs to 
train ■ teachers may be more effective as program 
valuators than those who have not had such experience . 
Although it is aoknowledged that objectivity will likely 
be greater when evaluation is^ conducted by persons other 
than those who^design and operate a specific programp It 
is nevertheless, argued that 'persons who, conduct program 
evaluation studies should have had general experience In 
such program development and operation* One must often 
settle for muoh less in program evaluation than 'one 
would like. Institutions that have conrtdudted follow-up 
studies of their graduates have experienced the^ 
^disappointment and discouragement of the dwindling . 
saiaple* Few Institutloris are using instrittnenti to 
evaluate teftohing p^er?formance with which they are 
satisfied.^ Whan; program evaluators have not experienced 
the oamplexlties and difficulties associated with 
prograip^ development .and operation, they may find it 
difficult to depart from conventional research 
orientations p When such orientations are imposed on 
pr^bgram evaluation efforts, much useful information is 
lost and many rioh opportunities are ovarlobkad* 
program evaluation oriaptation would expect to encounter 
oathpdologioal 'difficulties uriacoeptable for rasearoh 



and would suggest that regardless of this faGt, Insights 
can be gained and information useful to program 
improvement and hypotheses seeking can be obtained* 

The faoultv reward systems that operate in moat 
Instltutlona discou rage and often penalize the behavlora 
needed to develop and eval uate more effective teacher 
education programs . The reward systein in most 
Institutiona is Incongruent with what is needed to 
improve teacher eduoatlon. Rewards are generally won' 
for scholarly activity and teaching, usually defined in 
ways that place little value on products such as 
training designs. or materials and in-house reports of 
evaluation studies. For faculty to make changes 
necessary to adopt a new program, they must perceive 
that the effort will have Importance' amd significance to 
^them personally. They understandably expect payoffs for 
themsStves— recognition within the~systBm, increased 
salaries, and progress toward their long-range career 
goals— and they -want these rewards along the way. Most 
cannot afford to wait the decade it takes to design, put 
into opepation, and evaluate a new approach to teacher 
preparatlbn. In many cases, rewards diminish for 
faculty who get involved and stay involved. The time 
'these people spend, on program design, or developing 
instructional materials, or evaluation merely makes It 
more difficult for them to compete successfully with 
eolleagues who choose not to become involved. Sooner or 
later, most faculty begin to conform their behaviors to ' 
\what the system values. Administrators in colleges and 
universities have a special responsibility 'to provide 
the leadership to assure that teacher education Is 
valued and that faculty efforts related to improving 
programs "Tor, preparing teachers are rewarded. ■ 
'' . 

Acknowledgment of progra m evaluation data outs 
faoulty members at public risk. Difficult as evaluation 
of teacher education may be, it sometimes appears easier 
to obtain data_ than to get anything done about it once 
available. . Severar institutions have described faculty 
"Indifference to program evaluation data" (Hord and Hall 
1980). Ther*;is little indication that faculty welcome 
data about how their' courses or program dbmponents are 
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operatifig, and they often do little or nothing to modify 
or alter their praoticea on the basis of such 
information. Data appear to put faculty at "public 
risk." ir thjy acknowledge the data, they publicly must 
4dmit the possibility of their responsibility; if they 
accept their responsibility, they are expected to do 
something about problems that exist. The risks are 
great--more work for little payoff , and fear that data 
could be traced to them, thus comparing their more 
public performance against that of others who are more 
able to hide any flaws. 

Developing and evaluating more effeotive programs 
for preparing 'teachers is not always a scholarly 
activity; it ia sometimes a political activity . The 
teaGhing profession has a shallow research base. There 
is not widespread agreement regarding practices for 
educating teachers nor even general acceptance of what 
effeotive teachers do| empirical research has not 
validated the correlation between many teacher behaviors 
and pupil achievement. For these reasons, it is 
difficult for programs to maintain momentum over time. 
New ideas j which appear to offer great promise, pop up 
regularly and it is difficult not to be tempted into new 
directions. The political limelight shifts nationally 
and regionally from one approach to another! from CBTE 
to Teacher Centers, from handicapped, to gifted ^ from 
humanistic programs to computer technology , As the 
spotlight changes^ a program can. be lilumlnated or 
shadowed. Changes in direction can cause a loss of 
momentum in program development, which can seriously 
damage the ef feotiveness of a training program and 
discourage those Involved, 

To move the profession forward ^ those of us in 
teaching must respect and build upon the work of each 
other . Centuries ago, the Greek philosopher and 
geometrician Thales predicted a solar eclipse. People 
of his time thought he had performed a rairaele, but 
Thales ras no rairaele worker. He based his prediction 
on observations that other people had recorded over a 
500-year period* The Individuals before Thales v^o 
thoughtfully described the eclipses they saw probably 




were not always sure why they did so, and perhaps others 
of their time viewed their work as having little 
meaning* However, when summed and analysed, their work 
resulted in a major advance in humankind's quest to 
understand the natural world* 

The processes involved In the corapleK human 
interaction we oall education can be observed and 
described. It is important , we believe, to open up our 
quest for knowledge. We must come to understand and 
respect all genuine efforts to study teaGhlng. We must 
not be trapped into the posture that standardized and 
validated instruments are the only research tools that 
are useful. Sensitive, perceptive, thoughtful 
refleotions on the processes and outcomes of teaching 
may lead to the insights and hypotheses that will permit 
major breakthroughs, such as Thales' prediction. 

We must continually strive to build our knowledge 
bass systematically I piece by piece. In time, if enough 
investigators diligently pursue promising courses of 
study, more valid answers will emerge. Our profession 
will have its Thales who will give e^epression to the 
work of many unknown observers when the right moment has 
arrived. 
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APPENDIX A 



CHARACTERISTICS OF HOUSTON'S CBTE PROGRAM 



The following 12 characteristics were adopted by the 
College of Education faculty to give direction to the 
competency-based teacher education program. These are 
quoted from a memorandum' to the College faculty CHollis 
1975). • 

1. Compentency based i that is, the competencies to be 
demonstrated by the student are made explicit, the 
criteria to be^ applied in assessing the student*s 
competencies are made explicit,, and the student is held 
aecountable for meeting those orlteria. The emphasis is 
on the demonstration, not the acquisition, of those 
competencies specified as program expectations. 

2^ Carapus^centared and field oriented; that is, 
students are provided with opportunities to experience 
instruction and to demonstrate competence both on campus 
and in field sites depending upon the nature of the 
particular instructlonar or assessment activity and a 
determination as to where that activity can most 
effectively and efficiently take place. 

3. Role-model based | that is, a conceptual model of ^= 
the teacher* 3 role is used as a basis for identifying 
and specifying, those competencias atudents are expected 
to demonstrate. * 

Criterion-referenced I that is, assessment 
procedures are designed to determine whether or not a 
student has demonstrated competency at or above the 
level of mastery specified i the competency of each 
student Is Judged on the basis of predetermined criteria 
and is not determined through a comparison involving 
other students. 
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5. Pluralist ic; that is, there is oonsGlous acGeptance 
of the notion that no one philosophy of instruction has 
been proved best; Gonsequently , a variety of divergent 
views are posited as untested assumptions whioh the 
system must test, 

6, Humanized; that is, program design and operation 
recognize th? dignity and worth of each individual so < 
that each perGeives that he or she is being treated as 
one of worth. 

7# Personalized; that is, a student is provided with 
Instruction which takes into account his or her 
uniqueness, 

.8. Modularized ; that is, the delivery of instruction 
is accomplished through the utilization of Instructional 
Modules I instructional modules are sets of learning 
activities — rationale, objeotivess pref^equisiteSi 
pre-assessraent procedures ^ and remedial 
prooedures--which are Intended to facilitate the 
learner's acquisition and demonstration .of a particular 
oompetenoy or set of competencies. 

9# Multi-instructional I that is, the design and 
operation of the teacher education program is a 
responsibility shared by colleges, public schools, and 
the organized teaching profession. 

10. Systematized; that is, the systems approach is used 
in program design and operation » 

11. Regenerative* that is, the program is an open 
system capable of continuous revision on the basis of 
constructive data supplied by sound formative and 
summative evaluation procedures, 

12. A-systemwith alternatives within It^ that Is, the 
-program is a single single instructional system which 
constitutes an integrated, comprehensive whole | however, 
the system does acQoramodate a divergence of viewpoints 
within Its confines. 
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APPENDIX B 



GENERIC TEACHING COMPETENCIES 
ADOPTED FOR HOUSTON PROGRAM 



The following 16' eompstGnoiss were approved by the - 
Gollege of Eduaatlon faculty for use in identifying 
Initruotional objectives ^ designing instrUGtlonal 
materials J and evaluating parformanee* These are quoted 
from a memorandum to the college faoulty* 



> Identifies learner ^s emotional, sooial, physioal. 
and intell totiual nteds . Draws upon taiowledge of human 
growth and development, learning theories, 
sooial/oultural foundations, assessment teohnlques, 
ourrioulum goals and oontent In order %o gather 
information about the learner and to identify the 
instruotional needs* ^ 

2* Identifies and/or speoifies instruotional goals and 
ob.leotlv es which are based on learner ^s needs > Views 
the setting of instructional goals and objeotives as a 
key element in instruotion; reoonciles ourrioular and 
aduoational goals with present level of learner's needs; 
analyses instruotional goals to identify knowledge * 
skills, and attitudes needed to achieve those goals; 
states objeotives so that intent is clearly coimnunicated 
to learner. 

3* Designs instruotion appropriate to goals and 
objectives . Develops a variety of strategies for 
prompting achievement of instructional goals and 
objeotives which reflect the learner's needs and offer 
^the learner alternative ways of achieving those goals 
and object Ives p 



4* Implements instruction that is consistent with 
plan. Demonstrates the ability to use a variety of 
strategies which have -the potential to promote learner 
aehieveraent of specified Instructional goals and 
object4.ves . 

5. Designs an^ j,mp_l_em_ent3 evaluation proGedures which 
focus on learner achievement and instructional 

ef feotiveness • Evaluates learner performance with 
referenpe to a variety of "goals and objectives; reports 
learner achievement through grades ^ consultations , 
ohecklists and/or other appropriate means; evaluates 
instructional effectiveness by comparing learner's 
achievement with objectives, 

6. Integrates into Instruction the cultural - 
^^.. environment of students * Incorporates materials, 

examples, illustrations, m^otivatorsj and reinforcers 
from learner's cultural environment so that learner is 
able to identify with content, processes j and intended 
outcomes of inatruction. 

7. Demonstrates a repertoire of instructional models 
and teaching skills appropriate to specified objectives 
and to partioular learners * Describes and demonstrates 
a variety of instructional models; uses appropriate 
modjls of Instruction based upon the subject, objectives 
andlneeds of learners; uses teaching techniques 
appv*oprlate to those instructional models, 

8. Promotes effective patterns of conununication * 
Recognises the value of effective coDMnunication; 
communicates effectively verbally, nonverbally, and in 
writing; accepts and supports ideas of others | strives 
for more productive communication; and encourages 
Interaction among all members of the groups 

9. Uses resources appropriate to instructional 
objectives . Operates audiovisual equipment , makes 
Instructional materla^i Identifies sources of 
Instructional materials^^d uses Instructional materials 

' appropriate to objectives;^ organises resources in the 
^Qlassroom and comunity for instructional purposes. 




''0- Modifies instruQtlon on the basis of learner ^3 

verbal and nonverbal feadbagk during InstruQtlon , 
Demonstrates a uontLnuous awarenes.s of learner's ^ * 
activity to make declsLons regarding sucGess of 
instructional processes and learner achievement^; alters 
instructional processes on the basis of information thus 
obtained, 

^ ^ ' Uses organizational and management skills to 
establish a maximall y effedtlve Itarnlng'envTronmentV 
Establishes and maintains a classroom Glimate which" 
promotes individual achievement .and personal growth; 
organizes and encourages productive group interaction; 
and establishes positive relationships with and among' 
learners. 

12- Identifies^ and reaots with sensitivity to the needs 
and feelings of self and otheEB-7 -DemQn3tra"ta.^ a eon~cern 
for the nteds of laarners;' recognlies that as a memb#r 
of a learning group, the teacher has needs which must be 
met in a teaching- learning situation; and reacts to meet 
t^e- needs of learners, self, eo-workersS and parents. 

13- Exhibits openness and flexibility . Searches 
'Continually for vmys to improve instruotlonal 
effectiveness I listens oritloally to ideas of others, is 
open to suggestions, and bases decisions upon best 
available data. 

Works effectively as a member of a professional 
team. Works with others in order to achieve eonmonly 
shared goals; displays behaviors consistent with the 
goals anfl ethics of the teaching profession. 

^5* Analyzes professional effectiveness and continually 
strives to increase that effectiveness . Uses" a variety " 
of observational and analytic procedures to study 
teaching effectiveness; examines the consequences of 
teaching by focusing on learner objeetlves and 
instrjjctional outcomes. 
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] 0 • Designs and Irr^lements instrugtion which 
incorporatgs career educatiQn conoepts * Develops and 
utilises a variety of strategies for embedding career 
educat ton concepts Into course content and Instruct ional 
.aetiyitles; addresses the need for learners to^ learn 
about themselves, their environment , and the work roles 
played by individuals'- in society. 



Subsequently I three additional competencies were adopted 
by the Houston education faculty,- These are: 

17 * Organizes learni ng environments which meet the 
varying needs of learners* Assesses the Impact of 
various learning sn^-^lronments upon the learners' 
emotional and intellectual development; identifies a 
variety of* learning environment models | demonstrates the 
ability" to use various learning environments for 
Instructional purposes; systematically alters the 
learning environment as the needs of the learner change* 

1.8* Presents subject matter acQurately , Demonstrates 
adequate knowledge of the subject matter content 
presented and selects appnopriate subject natter for 
presentation* 

19* Identifies and teaches reading skills necessary for 
student understanding of given content areas. Assesses ^ 
and alters the difficulty level of Instructional 
materials; diagnoses the reading abilities of students; 
incorporates strategies for improving vocabulary, 
comprehensionj "and study skills appropriate to given 
content areas - 
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